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1 . Executive summary 



Project overview 

This project examined the cognitive effects of word-processing on writing processes and products. 
In particular, we examined effects on^ writers' planning, reviewing and revising In a series of six 
assessment studies. Among our most important findings are that writers using word processing alone- 
toth student writers and more experienced professional writers-engaged in significantly less initial 
planning, conceptual planning and total planning than when they used pen and paper, and that this 
phenomena was related to the difficulty experienced writers report in getting a "sense" of their texts and 
recalling them when using word-processing. As a result of our project, we recommend that student 
writers be explicitly taught how to exploit the benefits and avoid the weaknesses of both word processing 
and pen and paper media. We have disseminpt>^d our results and recommendations in courses and in a 
series of conference presentations, technical rc^ <>rts and publications in national journals. 

Background and Purpose 

This project set out to assess the cognitive effects of word-processing on student writers. At the 
time of the proposal, the possibility that word processing systems could radically improve both writing and 
the teaching of writing had been noted enthusiastically by many authors. The cause of this enthusiasm 
was easy to find: Word processing systems offer obvious advantages for certain writing functions such as 
text formatting, spell checking, and surface editing. It is also easy, though not necessarily justified, to 
extrapolate these advantages to writing as a whole. 

When we began the project, only a handful of studies had attempted to validate such extrapolations 
and actually assess the effects of word processors on writing. We reviewed those studies and argued 
that the question "Does word processing improve students' writing?" is more problematic than it appears 
and more complex than most previous studies assumed. We argued that studies were needed to ask two 
questions: 1) under what circums'.ances does the word processor help writers or improve writing? and 2) 
are the benefits worth the costs? 

We felt that until these questions were adequately addressed, school administrators would have 
little information on which to base decisions about crucial resource allocation issues. Likewise, writing 
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teachers would have littlff information on which to base decisions about the following crucial curriculum 
design issues: Is there a real, substantial benefit to my students fbr word processing or is their time better 
spent on other activities? Should I actually alloeate part of my limited class time to teaching students how 
to compose effectively with a word processor? if some of my students are using word processing, what do 
I need to know about word processors so that I can teach them most effectively? What kinds of changes, 
if any, should I make to my course content and pedagogy so that students receive maximum benefits 
from the interaction between instructk)n In writing and word processing technology? 

As institutions struggle with decisions about using computers to teach writing, we wanted to see 
tikom informed by reliable findings on the conditions that facilitate learning with computers. 

Project description 

We conducted six studies on three of the component writing processes where we thought word 
processing would have a significant impact. The following are the component processes and the 
corresponding studies: 

• Planning 

Study 1. How Word Processing Affects Pianning. Examined planning process of 
experienced and student writers in three conditions: word processing atone, pen and paper, 
combination of word processing and pen and paper. 

Study 2. Connecting process and product: A study of planning processes, text quality, and 
writing media. Examined the complex relationship between writing media and planning 
processes, and judged quality of the content and organization of the resulting essays. 

Study 3. Composing in Technological Contexts: A Study of Note-Making. Analyzed note- 
making In writing and compared this activity across pen and paper and word processing 
conditions. 

• Reviewing 

Study 4. A Naturalistic Study of Computer Writers' Reading Problems. Tracked six 
freshmen and five adult writers for the course of fbur months and examined the kinds of 
reading problems they had when using computers and how they used hard copy to 
supplement computer writing. 

Study 5. A Sense of the Text: Problems Writers Encounter in Building Text 
Representations. Examined how well writers understood their own texts, written with pen 
and paper or with word processing: also related this "sense of text" issue to planning 
processes. 

• Revision 

Study 6. Understanding On-line Revision. Examined revising behaviors of expert and 
student writers in two conditions, word processing or pen and paper. 

Project results 

Study 1. How Word Processing Affects Planning. Writers using word processing engaged in 
significantly less Initial planning, conceptual planning and total planning than when they used pen and 
paper. The effects were similar for both student writers and more experienced professional writers. A 
third condition, in which writers used both media, showed no clear effects: writers used both mec'ia 2 
together in vastly different and very complex ways. " 

Study 2. Connecting process and product: A study of planning processes, text quality, and writing 
media. Two measures of planning showed no relationships with quality, while two did. Initial planning- 
plannlng before beginning to write-had no significant relationship with either measure of quality. Local 
planning-at the word- and sentence-level-similarly had no relationship (positive or negative) with text 
quality. However, total amount of planning was significantly related to organizational quality, although the 
relationship of total planning to combined quality was not significant. The most significant relationships 
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were found with conceptual plannlnc. however. This idnd of planning showed a significant relationship 
with organizational quality and was also related to connbined quality scores. Although writers using word 
processing alone did signlficantiy less total planning and conceptual planring, there were no significant 
differences between the quality of essays produced with word processors alone and those producf^d with 
pen and paper. 

Study 3. Composing m Technological Contexts: A Study of Note-Making. Found that writers 
primarily made four Idnds of notes: content notes, by far the most prevalent; structure notes, also 
common, in which writers made outlines or otherwise structured their ideas: emphasis notes, less 
frequent, in which writers highlighted or emphasized certain Ideas; and procedural notes, quite rare, in 
which writers made notes to themselves about how to proceed. With word processing, writers tended to 
make content notes only, while with pen and paper they made a range of kinds of notes. 

Study 4. A NaturalisSc Study of Computer Writers' Reading Problems. This study used 
observational methods to study how computer writers use "hard copy" printouts of their texts. Eleven 
case study subjects were obsenred for four months. We found that writers use printouts primarily for 
reading, specifically, for four reading purposes: to checit format, to proofread, to reorganize, and to gain 
"a sense of the text" There were differences across groups of writers, with student writers being more 
concerned with fbrmat and proofreading and experienced writers readlrig tor all four purposes. Further, 
longer and more difficult tasits elicited more reading to reorganize and reading to gain a sense of the texl. 

Study 5. A Sense of the Text: Problems Writers Encounter In Building Text Representations. This 
study continued the examination of a problem that we began In Haas & Hayes (1986) and Study 3. 
above. In our !nten/iews with numerous computer writers and in our study of computer writers' reading 
problems we frequently encountered what writers themselves often called "a problem getting a sense of 
the text." We found that writers recalled more of the main points of their essays when they were 
composing with pen and paper than with word processing. The results suggest that writers use of paper 
to supplement their computer writing Is not simply a habit left-over from pre-computer training as many 
have speculated, but that it meets a real need that writers have to gain a sense of their own texts. 

Study 6. Understanding On-line Revision. Found no effects for writing medium-pen and paper or 
word processor-in any of the analyses. In general, the experienced writers revised like experienced 
writers and the students, like students, regaidiess of condition. In measures of task definition, problem 
representation, and detection and correction of errors, the medium U : which writers were working made 
little difference. While an effect of "no difference" Is not particulari> (jompeiling, In this case it is very 
Important. What this means is that we cannot expect that the word processor alone will make an 
appreciable difference in how writers revise. Sitting students down in front of computers and expecting 
their revision habits to change-as some authors have advocated-is simply not realistic. 

We have disseminated these results through courses, a workshop at our national convention on 
writing, through conference presentations, technical reports and publications in national journals. 

Summary and conclusions 

As a result of our studies, we believe that teachers should take active steps to insure that their 
students learn to use word processing effectively in composing. In particular, writing teachers with 
students who use word processing to compose shouM see that students: 

• Plan with a combination of pen and paper and word processing, not word processing alone, 
or compensate fOr reduced planning with word processing alone by using an appropriate 
planning tool that prompts planning (Kozma. mss). 

• Get frequent print-outs of drafts. A "paperiess" writing curriculum should not be encouraged. 

These recommendations have implications fCr administrators, who must insure that students have 
adequate access to printing facilities. 
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2. Project overview 

Our project was driven by the need we, as writing educators, saw for a systematic exploration of 
the effects of computers on writing. Speclficafiy, we set out to Increase our understanding of how a 
oomnfX)n computer writing tool--wnrd processing»effects the cognitive processes of writers. The project 
examined the cognitive effects of word-processing on writing processes and products. In particular, we 
examined effects on writers' planning, reviewing and revising in a series of six assessment studies. 
Arrwng our most important findincs are that writers using word processing alone-t>oth student writers and 
more experienced professional writers-engaged in significantly less total planning, Initial planning, and 
conceptual planning than when they used pen and paper and that this phenomena was related to the 
difficulty experienced writers report in getting a "sense" of their texts and recalling them when using 
word-processing. As a result of our project, we recommend that student writers be explicitly taught how 
to exploit the benefits and avoid the wealcnasses of both word processing and pen and paper media. We 
have disseminated our resuiis and recommendations in courses and in a series of conference 
presentations, technical reports and publications in national Journals. 



3. Background and purpose 

As computers gain a prominent place in many college writing curricula, the need for assessment of 
their effects becomes important. Enthusiasm fbr the potential of computers to aid both writers and 
teachers of writing had driven early efforts to establish computer-based writing pedagogy and to examine 
the benefits of using computer tools for writing. Much of this early research and evaluation of computer 
writing tools had, we argued, serious drawbacks. 

We saw 01^ task, then, as one of systematically examining some of the effects of computer tools for 
writing in order to establish a firm research base which could support important pedagogical decisions 
about computers and writing. We limited our project to a study of word processing: not only is the word 
processor the most widely available and widely used computer tool fbr writing, but newer, more 
sophisticated tools-outlining programs, "idea" processors, and so fOrth-are often built around and upon 
basic word processing technology. 



3.1. Our approach to assessment 

Computers' "effects," of course, are not unitary and the technology's impact upon writing may be 
myriad: computers may change classroom dynamics and social relationships among writers and their 
subjects; computers may cause affective changes toward writing and learning; computers may bring 
about interesting and Important changes In the fbrm and substance of written products, or equally critical 
changes In the processes by which writing Is produced. All of these potential areas of change are 
important ones to examine, but equally Important in systematic studies of pedagogical questions Is the 
need for a focused set of questions to pursue. Therefore, we limited our examination primarily to studies 
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of cognitive processes in writing and the effects that word processing technology may have on these 
processes. We believe that cognitive effects may be some of the most profound and wide-reaching of the 
many types of effects to accrue from the use of technology In writing. 

The goal of our project, then, was to systematically explore effects of using word processing 
technology for writing on the complex cognitive processes of writers. In this endeavor we were guided by 
a particular way of looking at writing: a cognitive process theory of writing. All research, we believe. Is 
driven by theory. However, some of the early work in the area of computers and writing failed to specify 
and articulate the theories of the researchers. In educational research particularly, dearly articulated 
theories of writing are of critical importance, coth to Judge the merits of the research Itself and to 
determine Its applicability to other problenu and situations. 

The theory which guided our approach to assessing the effects of word processing on writing draws 
on the theoretical work of cognitive process researchers in writing, such as John R. Hayes and Linda 
Rower at the Center for the Study of Writing (Ftower & Hayes, 1981 : Hayes, Flower, Schrlver, Stratman, 
& Carey, 1987; Flower. Schrlver. Carey. Haas. & Hayes, 1989) and Marlene Scardamalia and Carl 
Berelter at the Ontario Institute for Studies in Education (Bereiter & Scardamalia, 1987), among others. 
This cognitive process theory of writing holds ttiat writing Is a complex mental act, difficult to accomplish, 
to learn, and to analyze. Briefly stated, the tenets of tiie theory are: 

• Writing is a cognitive act, an act of mind. Of course, writing is-or can be--an act of other 
kinds as well: social, political, physical, emotional. But a critical distinguishing feature of 
writing is that It is a cognitive act, In which one writer (or a group of writers) draws upon the 
exigencies of the situation, her own experiences and beliefs, the expectations of her group 
and culture, and the resources available to her to make a purposeful, verbal statement. 

• Writing is a decision-making process. Writers make Important choices as they write to 
accomplish tf-.eir purposes. They decide If and when to write at all: they choose to address 
certain issues, problems, and audiences: they decide on appropriate tone, and wording, and 
voice. In this way, writing can be seen as an important and complex "problem." which a 
writer addresses by ttie choices he or she makes. These choices are guided by writers' own 
knowledge and purposes, of course, but they are also guided by a number of other critical 
factors. 

• A number of critical factors can Impact on the decisions a writer makes In the course of 
writing. Writing does not happen In a vacuum: writers' cultural, social, and physical 
environments shape writing in Important ways. Among the environmental factors shaping 
writing is the technology writers have available. 

• Writing can-although it may not always-be a way to form new conceptual knowledge. One 
of ttie reasons why educators are interested in writing is that very often writing involves the 
kind of complex thinking and conceptual reformulation that leads to "discovery," new Insights, 
and conceptual learning. 

A 

These tenets of a cognitive process theory of writing have been very important In guiding our work 
assessing the effects of word processing on writing. 
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3.2. The context of the assessment 

Specification and articulation of the setting of research is aiso important to judge the merits and 
applicabiiity of the findings. Like ail educationai assessments, ours took place in a particular time and 
place, with particular writers and writing technotogies. The site was a medium-sized private university in 
the midwest. The university has a strong reputatton both in engineering and technotogy and in the fine 
arts. 

Two distinct groups of writers within this setting participated in our research. For several of the 
studies, groups of second-semester freshman students were randomly selected for participaUon. The 
second group of writers were experienced, published writers-some academics, some graduate students, 
some teachers, and some professional writers. 

All participants were experienced with the computer and word processor used in the studies. Most 
of the experienced writers used the technology on a daily basis, and the students had completed both an 
introductory workshop using the computer technok)gy and a computer writing course using the word 
processor. In addition, each subject completed a "pre-tesf of facility with the computer and word 
processing technology used in the study in which he or she was participating. (Haas. 1987, contains the 
most complete account of this pre-test and other controls for computer experience.) 

The computer system used in the studies was the "Andrew" system, developed by IBM and 
Carnegie Mellon University at the Informatton Technology Center (Morris, et al. 1986). Individual 
workstations contain hard disks and are linked together via a network. The word processor, "EditTexr 
(and a similar subsequent version renamed "EZ") was also developed at the Information Technology 
Center and was based on EMACS. 

Both the Andrew workstation and EditText have a number of features particularly beni;ficiai for 
writers. The workstation is equipped with a large, 19-inch, high-resolution bit-mapped display. Users can 
see several "windows" at once; for instance, a writer could simultaneously view several documents or 
versions of documents. The workstation also has a mouse, and the same commands can be with the 
mouse and menus, or by using the keyboard. 

The EditText editor utilizes the large display and windowing capabilities of the Andrew system. In 
addition, variable fonts and styles are available. Writers move through documents using either keystrokes 
or mouse and scrollbar, which indk:ates graphically the size of the document and the current position in 
the '^jcument. The editor also contains a "preview" program to view an image of the printed page without 
printing. 

While this computer system is somewhat nrwre advanced than many currently available word 
processors, we argued In the original proposal that it made sense to use it for our assessment because 
this technology gives word processing the "best chance" to realize its potential benefits and it will be the 
technology that the nfX)st writers who use word processing will have available in the coming decade. 
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4. Project description 



Our original goal for the project was a of series studies, focusirn) on three subprocesses of writing: 
planning, reviewing, and revising. While some of the studies in the original proposal changed, the final six 
studies we conducted did address these three areas: 

• Planning 

Study 1. How Word Processing Affects Planning. Examined planning process of 
experiences and student writers in three conditions, word processing alone, pen and paper, 
and word processing and pen and paper; a study from the original proposal. 

Study 2. Connecting Process and Product: A Study of Planning Processes, Text Quality, 
and Writing Media. Examined the complex relationship between writing media, planning 
processes, and Judged quality of the content and organization of the resulting essays; a 
study from the original proposal. 

Study 3. Composing in Tectinotogical Contexts- A Study of Note-Mafdng. An in-depth 
analysis of note-mal(ing in writing and a comparisori of tl'is activity across pen and paper and 
word processing conditions: a study added in Year 3. 

• Reviewing 

Study 4. A Naturalistic Study of Computer Writers' Reading Problems Tracked six freshmen 
and five adult writers tor the course of tour months and examined the kinds of reading 
problems they had when using computers and how they used hard copy to supplement 
computer writing; a study from the original proposal. 

Study 5. A Sense of the Text: Problems Writers Encounter In Building Text 
Representations. Examined how well writers understood their own texts, written with pen 
and paper or with word processing; also related this "sense of texf to planning processes; a 
study added In Year 2. 

• Revision 

Study 6, Understanding On-line Revision. Using as a prototype the seminal Hayes, et al.. 
study (1987), this study examined revising behaviors of expert and student writers in two 
conditions; a study from the original proposal. 

This final set of studies reflects several changes from our original proposal. Our original plans 
changed for a number of reasons. First, as tt-ie project proceeded, we learned a great deal and 
consequently chose to pursue some new lines of inquiry. For instance, in conducting Study 4 ("A 
Naturalistic Study of Computer Writers' Reading Problems"), we were able to describe the "text sense* 
problem more completely; this made Study 5. which looked in more detail at this problem, possible. 
Second, the analysis of some of the data was more complicated than we had originally anticipated, and 
we chose to look at some of the writers and writing in more detail, rather than coilectinn more data and 
treating it superfidally. This was the case In Studies 2 and S: in conducting Study 1. we became 
convinced of the importance of piannlng-and the critical role that technological contexts may play in 
writers' planning-and we were led back to the rich protocol and textual data generated In this study for 
use in Studies 2 and 3 ("Connecting process and product: A study of planning processes, text quality, 
and writing media" and "Composing in Technological Contexts: A Study of Note -Making"). 
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Focusing our studies in this way limited both the number of studies we could conduct and the questions 
we oould pursue. However, we felt, given the complexity of both the technology's effects on oonposing 
and the educational policy questions at issue, that a deeper understanding of a few key aspects of 
composing would in the long run be more satisfying and more valuable. 

5. Outcomes and results 
5.1. Results of the studies 

study 1. How Word Processing Affects Planning. Writers using word processing alone engaged in 
significantly less total planning, initial planning, and conceptual planning thi n wh6n they used pen and 
paper. The effects were similar for both student writers and more experienced professional writers. A 
third condition. In which writers used both media, showed no clear effects: writers used both media 
together in vastly different and very complex ways. (Study completed in Year 2.) 

Study 2. Connecting Process and Product: A Study rf Planning Processes, Text Quality, and 
Writing Media. Our original plans included an analysis of quality fOr the essays produced in the three 
conditions in Study 1. This analysis was carried out, but as we thought more about the issues underlying 
our comparison of texts, we expanded the analysis to include ra. p;.)cess component as well as the 
assessment of the written product. Our thinking went like this: when we as educators expect quality 
diiferences in essays composed with computers and with pen and paper, we are making assumptions 
about quality which often remain only implicit. That Is, we don't expect that there is something inherent in 
a word processor that allow writers to produce better essays as if by magic. What we do expect, if we 
indeed expect an advantage for computer-written essays, is that the witing media will somehow facilitate 
or change the process by which writing Is produced, therefore resulting in "better" writing. 

Therefore, our design of this study changed somewhat. In addition to a comparison of the essays 
written in pen and paper and word processing conditions, we built in a second analysis in which we 
related product quality to writing process. Specifically, planning-seen by many theorists and educators 
as aitical to writing success-was related to resulting quality scores. 

Tv^enty writers wrote essays in three conditions: pen and paper, word processing and word 
processing with pen and paper allowed, resulting in a total of 60 essays. These essays were Judged by 
experle''iced teachers of writing within subjects; that Is, each writer's essays were compared only to his or 
her other essays and within each set of three essays by one writer, judges placed each on a scale of 1 to 
3. Three measures of quality were used: content quality, organizational quality, and combined quality. In 
each case-content, organization, and combined-scores of pen essays v ere slightly higher than word 
processing essays (means- 2.1 and 1.7, 2.2 and 1.7, and ;..1 and 1.8, respectively) with the condition 
using both word processing and pen and paper falling in the middle. However, these scores were far 
fiom significiint. 
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In the second phase of our analysis. fOur measures of planning (for which significant results had 
been obtained in Study 1. above: see Haas, 1989b) were selected for comparison with quality ranking: 
total planning, initial planning, conceptual planning, and local planning. This analysis focused on the pen 
and word processor conditions as the two extreme oonditions-both In planning and in quality-established 
with the prior analyses. Therefore, eight separate analyses examined the relationship of the four kinds of 
planning-totai, Initial, conceptual, and local-with the two measures of quality: organization quality and 
combined quality. (Content quality was not included because of tow reliability on this measure.) 

Analysis revealed that two measures of planning showed no relationships with quality, while two 
did. Initial pianning-planning before beginning to write-had no significant relationship with either 
measure of quality. Local planning-at the word- and sentence-ievei-simiiarly had no relattonship 
(positive or negative) with text quality. 

However, total amount of planning was significantly related to organizational quality, although the 
relationshio of total planning to combined quality was not significant. The most significant reiattonships 
were found with conceptual planning, however. This kind of planning showed a significant relattonship 
with organizational quality and was also related to combined quality scores. Table 2-1, below, 
summarizes the results of this second part of the analysis. 

Table ^-l; Significant relationships between planning and quality* 

Quality 

Organization Combined 

Planning 

Total p<.05 NS 

initial NS NS 

Conceptual p<.01 p<.05 

Lxjcai NS NS 

Vsing contingency coefficient C, N'lS 

These results, while tentative (given the small number of subjects}, offer an encouraging start in 
understanding how process and product differences are related. The results are encouraging, for they 
reinforce what teachers and researchers believe: that planning is important and beneftoiai, that It has 
some relationship with the written text, that conceptual, high-level thinking during writing is valuable, even 
critical, for written composition. 

Again, these results do no/ suggest that there are important quality differences for writing done on a 
word processor. However, as computer technotogy becomes more useful for writing and more suitable 
for teaching writing-parttouiariy In the support of pianning-there is every reason to suppose that essays 
produced with computers. // they were also planned extensively, could be higher In quality. (Study 
completed In Year 3.) 

Study 3. Composing in Technological Contexts: A Study of Note-Making. This study used both 
descriptive and experimental methods to examine the kind of planning notes made by experienced writers 
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composing with pen and paper and with word processing. The study defined a range of note-maldng 
strategies that writers can use, regardless of writing medii^im, and fbund that these nine writers primarily 
made fbur kinds of notes: content notes, by far the most prevalent; structure notes, also common, in 
which writers made outlines or othenwise structured their ideas; emphasis notes, less frequent, in which 
writers highlighted or emphasized certain Ideas; and procedural notes, quite rare, in which writers made 
notes to themselves alMut how to proceed. 

By contrasting the same writers' note-making In pen and paper and word processing conditions, we 
were able to see differences In the kinds of notes writers make with pen and paper and with word 
processing. With word processing, writers tended to make content notes only, while with pen and paper 
they made a range of kinds of notes. Detailed analysis of indivkiual writers' note*making showed that 
kind and the complexity of notes was influenced by the writing medium. For some writers, notes made 
with word processor were much more text-like than note-like. Based on theories of composing and 
transcribing, and on this analysis of note-making, the study also speculates on the way that current word 
processing technology may Influence both writers' strategies and the approach they take to writing tasks. 
(Study completed in Year 3.) 

Study 4. A Naturalistic Study of Computer Writers' Reading Problems. This study used 
observational methods to study how computer writers use "hard copy" printouts of their texts. Eleven 
case study subjects were observed for four months. We fbund that writers use printouts primarily for 
reading, specifically, for four reading purposes: to check format, to proofread, to reorganize, and to gain 
"a sense of the text." Th^'-e were differences across groups of writers, with student writers being more 
concerned with format and proofreading and experienced writers reading tor all four purposes. Further, 
tonger and more difficult tasks elicited more reading to reorganize and reading to gain a sense of the text. 
(Study completed in Year 1). 

Study S. A Sense of the Text: Prot)lems Writers Encounter In Building Text Represenisflons. This 
study continued the examination of a problem that we began in Haas & Hayes (1986) and Study 3, 
above. In our interviews with numerous computer writers and in our study of computer writers' reading 
problems we frequently encountered what writers themselves often called "a problem getting a sense of 
the text." When using word processing, these writers spoke of often feeling confusion about the shape 
and form of their own emerging texts. Typically, writers would print their texts to alleviate this problem. 
Some writers said that they often couldn't even judge the merits of their texts until they saw them printed 
out. This problem seemed to go beyond a necessity to read-to-revise: many of the writers simply felt 
they didn't "know" their texts as well when they composed them on-line. 

Our eariier efforts to explore this problem centered on examining display variables of computers 
that might cause, or alleviate, the problem (H?as & Hayes, 1986; Hansen & Haas. 1988), or on exploring 
writer or task differences that might effect it (Haas. 1989a). The current study examined the existence of 
the phenomenon itself, by testing whether writers do indeed "know" their texts less well, or have less of a 
"sense of te)^," when composing on-line. 

54 



ERIC 



11 



Ten experienced writers composed essays In pen and paper conditions. Two weeks after the initial 
wrltlnQ session, writers were again shown the materials they had used in the writing (topic, instructions) 
anc' asked to recall "in as much detail as '>08Sible" the main points of their essays in order. Writers 
attempted to recall both essays they had written, in the order in which they had originally created them. 
Measures were taken of the time it took writers to recall their texts, as well as the accuracy of the recalls. 

There were no differences in the time it took writers to recall the texts written with different media, 
but there were significant differences In the accuracy scores: writers recalled more of the main points of 
t:ieir essays when they were composing with pen and paper. In order to partially explain these results, 
we related writers' planning times (as measured in clauses of think-aloud protocols) to their text recall 
scores and found that those texts which writers planned most extensively were also recalled in greater 
detail. In this way, we begin to see a relationship between what previously had seemed to be disparate 
problems: repressed planning with word processing, and the text sense problem. 

These results strongly suggest that the "text sense" problem that writers report when using word 
processing has some psychological reality. It also suggests that writers use of paper to supplement their 
computer writing is not simply a habit left-over from pre-computer tralning-as some authors have 
speculated~but that it meets a real need that writers have to gain a sense of their own texts. (Study 
completed in Year 3.) 

Study 6. Understanding On-line Revision. This study used as a prototype the 1987 Hayes, Flower, 
Schriver, Siratman, and Carey study of revision, partially replicating the earlier study-in comparing two 
groups of writers' revision behavior-but also examined differences in revising for the same writers using 
writing media (pen and paper or word processor). Sixteen writers, eight from each group, participated in 
the study. In each condition, writers revised a somewhat disorganized and informal letter into a pamphlet 
or brochure to be used by a specific audience. The task required writers to attend to local problems in the 
text, as well as larger concerns such as tone, contradictory or missing information, and suitability to the 
audience. 

Analysis of the resulting think-aloud protocols and texts focused on 1), Task Definition, or the 
writers' knowledge about and conception of the problem of revision that lies before them; 2), Levels of 
Problem Representation, or the kind of problem-global or local-upon which the writers focused: 3), the 
Detection and Correction cf Errors, or the number of planted errors that whters explicitly mentioned and/or 
corrected during their revising sessions. 

Results in general corroborated the findings of Hayes et al. in terms of expert-novice differences. 
TTie experienced writers fbcused on more global concerns in their revising than did the students, whose 
comments and revisions tended to cluster at the local level. The experienced writers also found and 
corrected more errors than did the students, and although the students mentioned more of the errors, the 
experienced writers corrected more of them. 
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Interestingly, there were no effects for writing medium-pen and paper or word processor-in any of the 
analyses. In general, the experienced writers behaved like experienced writers and the students, like 
students, regardless of condition. In measures of task definition, prot>iem representation, and detection 
and correction of errors, the medium In which writers were working made iittie difference. 

While an effect of "no difference" is not particularly compelling, in this case it is very important. 
What this means is that we cannot expect that the word processor alone will make an appreciable 
difference in how writers revise. Sitting students down in front of computers and expecting their revision 
habits to change is simply not realistic. The complexity of revision, the importance of what a writer wants 
to accomplish revision, the writer's goals for both the text and for the revision process-tenets of our 
theories of revision (Hayes, et al, 1987; Scardamalia & Bereiter, 1983}-'are reinforced by the results of 
this study. If we wish to change our students' reviston behaviors, then changing their conceptions of and 
goals for revision must accompany any changes in their writing tools. (Study completed in Year 3.) 

5.2. Changes in our conception of tiie probiem 

In addition to the results of the studies themselves, some of the most important results of our 
project were changes in our own thinking about the question of how word processors affect writing. First, 
doing the project sharpened our ability to tease out differences and relationships. For instance, 
unpacking common assumptions about quality in writing led us to redesign our analysis of Study 2 to 
include a process component, and further, to reformulate our thinking on the complex relationship of 
writing quality and writing process. 

The project also changed our thinking in another, somewhat different way: it helped us to see 
relationships between problems that we had thought disparate. In studying what had seemed at the 
outset to be the separate problems of planning, text sense, and writing quality, we rume to see that these 
components of writing are in fact intrinsically related. So. two of the final studies that we completed 
(Studies 2 and 5) crossed some of the "boundaries" that we had mistakenly set up between aspects of 
the problem. While it is often beneficial to divkle problems, we also realized a need to step back and see 
how seemingly separate problems are really related. 

Finally, the project helped to reaffirm and support some of our previous assumptions about writing 
and technology: 

• that planning is a critical and wide-ranging process of writing 

• that technology does and will have effect-both for good and for ill-on writing 

• that awareness of those effects can allow us to channel them 

• that the most important variables in successful writing (in terms either of quality or of 
learning) may not be technok>gical. but more complicated-and more difficult to control- 
things like goals, and context, and knowledge. 
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5.3. Educational implications 

We believe that our project has Important educational implications and our work has already begun 
to mal(e an impact on how computers are used in writing education. Four of the most important 
implications are these: 

1. Writers use word processors in complex and varied ways. Our computer writing pedagogy 
should allow a range of ways to use the technology. It should even encourage various ways of using 
technology as a way to continue to learn how word processing--and other, newer technologies-support or 
inhibit writing (Studies 1 . 2, 3, 5). 

2. While acknowledging that various approaches to using word processing should be encouraged, 
we also believe that students may need guidance in using technok}gy to its full advantage. Students 
should be encouraged to print their texts often and to use these printouts for review; they should also be 
discouraged from focusing too narrowly on the kind of surface level thinking that is so greatly facilitated by 
the machine. In addition, teachers should provide explicit (and possibly visual and graphic) support foi 
the critical act of planning throughout the writing process. Further, teachers should encourage their 
students to be good observers of themselves and their writing styles, becoming aware of and pointing out 
to others where the technology particularly helps or hinders them (Studies 1 . 3, 4, and 6} 

3. Technology alone cannot and should not be expected to make significant improvements in 
students' writing processes or written products. Dedicated teachers, informed pedagogy, relevant and 
accessible Instruction-these may. with the best technological supports, change students' conceptions of 
writing, their feelings about it. and their skill at accomplishing it. Word processing alone cannot (Studies 

2. 4, and 6). 

4. Computer technology fbr writers should be improved. Our project has revealed a number of 
ways that existing word processing technology causes writers problems~in viewing their texts globally, in 
planning their content and structure, in critically Judging them. However, these problems are not inherent 
in the technology: word processing is a tool, developed for human use. which can be changed and 
adapted to meet the needs of those it is designed to serve. We believe that educators, experienced with 
computer technology, are in an ideal positton to Judge, criticize, and provide feedback on how existing 
writing tools can be improved and we encourage all educators to be vocal and responsible consumers of 
technology (Studies 1 , 2, 3, and 5). 

5.4. Impact and dissemination 

Our results have been incorporated into the curriculum at Carnegie Mellon and we have worked to 
disseminate those results and encourage their incorporation at other schools as well. 
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5.4.1. Courses and workshops 

All undergraduates at CMU are required to take a designated writing course; most students take it 
as freshmen. Most of the teachers of that course, Ph.D. in rhetoric students, study the research reported 
here and its educational implications in a required graduate course and are encouraged to apply those 
findings in their own teaching practice. 

Last year, we presented a day tong work^^riop at College Composition and Communication, CCCC 
which represented the results of our project and asked participants to work toward incorporating them into 
their own curriculums. This workshop was sponsored by the CCCC Committee on Computers and 
Composition. The Committee sponsors one each year. Chris Neuwirth Is a member of the committee, 
and although she is not conducting the workshop this year, she has requested that the results be made 
available to participants again. The workshop materials are also available as a CMU-CECE Technical 
Report. 

5.4.2. Technical reports 

CMU^ECE^TR^ Word Processing as Decision-making: Writers' Choices of Writing Media. 

CMU-CECE-TR-5 'Seeing it on the Screen Isn't Really Seeing It": Reading Problems of Writers Using 
Word Processing. 

CMU<:ECE-TR-e How the Writing Medium Shapes the Writing Process: Effects of Word Processing 
on Planning. 

CMU-CECE-TR-9 Understanding On-line Composition: Applying a Cognitive Model of Revision to 
Word Processing. 

CMU*CECE*TR-io Composing In Technological Contexts: A Study of Note-Making. 

CMU-CECE-TR-11 A Sense of the Text: Problems Writers Encounter In Bulkilng Text 
Representations. 

CMU<ECE-TR-i2 Theory and Research into Practice: Word Processing and Writing Instruction. 

5.4.3. Conference Presentations 

Presentations by Haas based on FIPSE-supported work included: "A Sense of the Text: The Role 
of the Emerging Text In the Composing Process." presented at the Conference on College Composition 
and Communication In March. 1989: "What Is the Potential of the Word Processor as a Composing Tool? 
A Study of Planning.' presented at the American Educational Research Association Annual Meeting In 
April. 1989; and "A Sense of One's Own Text: Problems Writers Encounter in Building Text 
Representations." presented at the National Reading Conference in November. 1988. A presentation 
based on Study 6. "Understanding On-Llne Revlston." was also presented at the Amerk:an Educational 
Research Association Annual Meeting in April. 1989 by Charles Hill and David Wallace. 
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5.4.4. Publications 

Publications by Haas of FiPSE-supported work included: "How the Writing Medium Shapes the 
Writing Process: Effects of Word Processing on Pianning," which appeared in Research in the Teaching 
of English in May. 1989. and "'Seeing It on the Screen Isn't Really Seeing It': Computer Writers' Reading 
Problems," in Gail Hawlsher and Cynthia Selfe (Eds.), Critlcai Perspectives on Computers and 
Composition Instruction, published by Teachers College Press. An article based on Study 3 ("Composing 
In Technological Contexts: A Study of Note-Making") has also been submitted to Written Communication. 

5.4.5. Tool design 

We are working to Incorporate results Into the design of new writing tools (Neuwirth & Kaufer, 

1989). 

6. Summary and conclusions 

As a result of our studies, we believe that teachers should take active steps to Insure that their 
students learn to use word processing effectively In composing. In particular, writing teachers with 
students who use word processing to compose should see that students: 

• Plan with a combinatton of pen and paper and word processing, not word processing alone, 
or compensate for reduced planning with word processing alone by using an appropriate 
planning tool that prompts planning (Kozma, In press). 

• Get frequent print-outs of drafts. A "paperiess" writing curriculum should not be encouraged. 

These recommendations have implications for administrators, who must Insure that students have 
adequate access to printing facilities. 
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8. Appendix 

1. What forms of assistance from FIPSE were helpful to you? How can FIPSE more effectively 
work with projects? 

At the beginning of the project, FIPSE asked us to hold a symposium on the effects of word 
processing In which we Invited other researchers to present their current work and to discuss and critique 
the plans fdr our work. We (bund this useful. In other grants, we have had similar "advisory boards" of 
experts and have generally fbund it useful to meet once a year to review progress and critique plans. 

Also of value was FIPSE's role in putting us in touch with other FIPSE'funded projects doing 
related work. 

2. What should the FIPSE staff consider in reviewing future proposals In your area of interest? 
What are emerging new directions? What are key considerations, given your type of project? 

Three directions are emerging in the use of computers in composition tools: the composition of 
non-linear texts (i.e., hypertexts or hypermedia), the use of hypermedia to support writing processes, and 
the use of computer networks In the teaching of writing. The key consideration in any assessment of 
these tools Is that the researchers base the assessment on a theory of cognitive and social 
consequences of these tools. 



